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DETAILED ACTION 

Response to Arguments 

1 . Applicant's arguments, see pgs. 12-16, filed November 18, 2008, with respect to the 
rejections of claims 1-2, 7, 9-10, 12-13, 15-16, 21-22, 25 and 27 under 
U.S.C. 103(a) have been fully considered and are persuasive. Therefore, the 
rejection has been withdrawn. However, upon further consideration, a new grounds 
of rejection is made in view of Cobbley et al, U.S. Patent No. 5,818,510 (hereinafter 
Cobbley), Maybury et al., U.S. Patent No. 6,961,954 B1 (hereinafter Maybury) and 
Gary Culliss, U.S. Patent Pub. No. 6,014,665 (hereinafter Culliss). 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

1. Claims 1, 2, 7, 9, 10, 12, 21, 22, 25 and 27 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Kanevsky et al., U.S. Patent No. 6,434,520 B1 (hereinafter 
Kanevsky) in view of Geshwind, U.S. Patent No. 7,080,392 B1 (hereinafter 
Geshwind), Cobbley and Maybury. 

Regarding claims 1 and 21: Kanevsky discloses a processor-readable 
storage medium comprising processor-executable instructions and a system for 
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executing those instructions (see [abstract], [col. 2, II. 28-35] for a program 
tangibly embodied on a program storage device and system for executing said 
program) configured for: receiving a request for information regarding a media 
object (see [figure 3 no. 301 and 302], [figure 4a], [col. 1 , II. 57-60], [col. 8, II. 49- 
61], [col. 9, II. 4-9] for user queries used to index information media objects); 
inferring the information from repeat instances of media objects ([col. 9, II. 34-46], 
[col. 10, II. 10-24] for identifying matching (repeating) media segments that have 
similar or matching voiceprints) occurring within one or more media streams (see 
[col. 2, II. 57-66] for identification in multiple media streams; see also [col. 1, II. 
17-27], [col. 1 , II. 61 through col. 2, II. 4], [col. 2, II. 60 through col. 3, II. 4] for 
multiple media sources such as, radio, television, video, telephone, and data 
streams from which media objects can occur, etc.); and returning the information 
(see [col. 2, II. 1-4], [col. 9, II. 4-9] for retrieving/ obtaining audio segments 
resulting from the search) but is silent regarding wherein the inferring comprises 
comparing temporal lengths of repeat instances of the media object with one 
another to determine different versions of the media object, the different versions 
of the media object selected from the group comprising: a longest version of the 
media object; a number of longer versions of the media object; a shortest version 
of the media object; a number of shorter versions of the media object; wherein 
the inferring further comprises determining a number of related media objects, 
wherein: (i) the related media objects are determined based on temporal 
proximities of media objects relative to the media object associated with the 
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request, and (ii) the related media objects have a higher frequency of repeat 
instances to one another. 

Geshwind teaches a system and method of organizing media to produce a 
selected subset of data for the user. This subset is organized by producing levels 
of abstraction such that a longest version of a media object (referred to herein as 
a "full program") and a shortest version of a media object (referred to herein as a 
"highlight") are available for viewing. Geshwind also teaches where the longest 
version includes a portion of another selectable media object where said 
selectable media object is temporally shorter (see [abstract], [col. 4, II. 24-38], 
[col. 4, II. 46-48], [col. 6, II. 1-32], [col. 7, II. 51-60], [col. 15, II. 57-64], [col. 16, II. 
9-13], [col. 23, 11.56-61]). 

At the time the invention was made, it would have been obvious to one of 
ordinary skill in the art to provide a means to select different temporal length 
versions of a media object, as taught in Geshwind, when providing a system 
capable of searching for and making available repeat instances of media objects, 
as taught in Kanevsky, because the user may only want to hear a specific 
temporal length or summarized version of media (see [col. 2, II. 33-36], [col. 5, II. 
63-66]). 

Cobbley teaches an indexing system which determines related media 
objects based on temporal proximities of media objects relative to a requested 
media object (see [abstract], [cols. 5-6, II. 56-3], [col. 7-8, II. 53-15], [col. 8, II. 23- 
64] where the system is able to track multiple versions of a particular program or 



Application/Control Number: 10/686,240 Page 5 

Art Unit: 2423 

story segment and able to "know" that a video is related due to repeat 
transmissions). 

Therefore, it would have been obvious to one of ordinary skill in the art at 
the time the invention was made to modify the searching methodology used to 
identify and index multimedia information by enabling the system to use temporal 
proximities to make determinations about the relation of multimedia as taught by 
Cobbley in order to identify more recent versions of a particular program or story 
segment. 

Maybury teaches an indexing system which determines related media 
objects based on the frequency of repeat instances relative to one another (see 
[col. 3, II. 13-24], [col. 4, II. 14-25], [col. 21, II. 30-53] for using the frequency of 
multimedia data to determine relationships of portions/segments of stories). 

Therefore, it would have been obvious to one of ordinary skill in the art at 
the time the invention was made to modify the searching methodology used to 
identify and index multimedia information by enabling the system to use the 
frequency of data extracted from multimedia to make determinations about the 
relation of multimedia as taught by Maybury in order to provide a more efficient 
means to search and analyze multimedia. 

Regarding claims 2 and 22: The combined teachings of Kanevsky in 
view of Cobbley and Maybury, teach wherein the inferring comprises searching a 
database for the information (see Kanevsky [col. 1 , II. 7-15], [col. 1 , II. 57 through 
col. 2, II. 4], [col. 9, II. 4-9] for searching a database), the database including 



Application/Control Number: 10/686,240 Page 6 

Art Unit: 2423 

media objects and records of repeat instances of the media objects (see 
Kanevsky [col. 9, II. 34-46], [col. 10, II. 10-24] for storing media objects and 
matching (repeat) segments that have been archived and are available for 
retrieval). 

Regarding claims 7 and 25: The combined teachings of Kanevsky in 
view of Cobbley and Maybury, teach wherein the inferring comprises matching a 
key word from the request with metadata extracted from a media object (see 
Kanevsky [col. 7, II. 22-26], [col. 8, II. 49-52], [col. 8, II. 61-66], [col. 10, II. 50-53] 
for matching associated identity tags). 

Regarding claims 9 and 27: The combined teachings of Kanevsky in 
view of Cobbley and Maybury, teach wherein the inferring comprises limiting 
returned media object based on constraints contained within the request (see 
Kanevsky [col. 5, II. 2-12], [col. 7, II. 60-67], [col. 10, II. 2-9] where the search can 
be limited to "N" best lists as defined by the requester). 

Regarding claim 10: The combined teachings of Kanevsky in view of 
Cobbley and Maybury, teach wherein the inferring comprises identifying temporal 
endpoints of each repeat instance of the media object (see Kanevsky [col. 9, II. 
40-46], [col. 10, II. 16-20] for storing matching (repeating) segments; see also 
[col. 3, II. 19-29] where the start and end times are identified for all segments). 

Regarding claim 12: The combined teachings of Kanevsky in view of 
Cobbley and Maybury, teach including the use of a computer comprising the 
processor-readable medium (see Kanevsky [col. 2, II. 28-56] for using a 
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computer platform where a computer is inherently capable of acting as a server 
or client computer). 

2. Claims 13, 14 and 15 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Kanevsky in view of Cobbley, Maybury and Culliss. 

Regarding claim 13: Kanevsky discloses a processor-readable storage 
medium comprising processor-executable instructions (see [col. 2, II. 28-56]) 
configured for: receiving a first user input regarding a first media object sending a 
first request for one or more additional media objects based on the user input, 
the one or more additional media objects each including a portion of a media clip 
in common with the first media object; receiving at least one of the one or more 
additional media objects; (see [abstract], [cols. 1-2, II. 57-4], [cols. 4-5, II. 66-12], 
[col. 8-9, II. 49-20], [col. 10, II. 50-62] for retrieving a desired media segment after 
receiving a user input for searching media segments where the said retrieved 
segment or more additional media objects are received as a result of the search 
within the media database and wherein the media object can share a portion of a 
media clip in common with the first media object) but does not teach: 

receiving a second user input regarding a second media object; 

sending a second request for one or more related media objects based on 
the second user input, the one or more related media objects comprising media 
objects that occur within a close temporal proximity of the second media object; 

receiving at least one of the one or more related media objects; 

rendering the received related media object; 
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receiving a third user input regarding a third media object; 

sending a third request for one or more most-popular media objects based 
on the third user input, the one or more most-popular media objects comprising 
media objects having a higher frequency of repeat instances relative to one 
another; 

receiving at least one of the one or more most-popular media objects; and 

rendering the received most-popular media object. 

Cobbley teaches an indexing system which renders a media object after 
receiving a user input, searches media (by sending a request for one or more 
related media objects based on the input) and determines related media objects 
based on the temporal proximity of the media object (see [abstract], [col. 6, II. 56- 
3], [cols. 7-8, II. 53-15], [col. 8, II. 23-64], [col. 10, II. 26-42]). 

Therefore, it would have been obvious to one of ordinary skill in the art at 
the time the invention was made to modify the searching methodology in the 
indexing system of Kanevsky by enabling the system to use temporal proximities 
to conduct another search to make determinations about the relation of 
multimedia as taught by Cobbley in order to identify more recent versions of a 
particular program or story segment. 

Maybury teaches an indexing system which renders a media object after 
receiving a user input, searches media (by sending a request for one or more 
related media objects based on the input) and determines related media objects 
based on the frequency of repeat instances relative to one another as well as the 
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popularity or importance of the media (see [col. 3, II. 13-24], [col. 4, II. 14-25], 
[col. 21 , II. 30-53] for using the frequency of multimedia data to determine 
relationships of portions/segments of stories; see also [cols. 6-7, II. 53-2], [col. 
16, 11.48-61]). 

Therefore, it would have been obvious to one of ordinary skill in the art at 
the time the invention was made to modify the searching methodology used to 
identify and index multimedia information by enabling the system to use the 
frequency, popularity (importance) of data extracted from multimedia to make 
determinations about the relation of multimedia as taught by Maybury in order to 
provide a more efficient means to search and analyze multimedia. 

While Kanevsky, Cobbley and Maybury teach rendering a media object as 
a result of a search neither explicitly teach an ordered first second or third 
search. 

Culliss teaches a method of searching which allows searchers to input a 
first, second and third search query to narrow their body of search (see 
[abstract], [cols. 2-3, II. 65-9], [claim 5] where a user makes multiple search 
request to narrow the search field). 

Therefore, it would have been obvious to one of ordinary skill in the art at 
the time the invention was made to modify the searching methodology of 
Kanevsky, Cobbley or Maybury by providing multiple search inputs and request 
as taught by Culliss in order to narrow and focus a search to provide more 
relevant results. 
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Regarding claim 15: The combined teachings of Kanevsky in view of 
Cobbley, Maybury and Culliss, teach a processor-readable medium comprising 
further processor-executable instructions configured for rendering a media 
stream that includes the media object (see Kanevsky [col. 3, II. 12-29] for 
processing (rendering) the audio data as it streams to determine the desired 
locations in the stream to be segmented). 

Regarding claim 16: The combined teachings of Kanevsky in view of 
Cobbley, Maybury and Culliss, teach including the use of a computer comprising 
the processor-readable medium (see Kanevsky [col. 2, II. 28-56] for using a 
computer platform where a computer is inherently capable of acting as a server 
or client computer). 

3. Claims 3, 1 1 and 23 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Kanevsky in view of Geshwind, Cobbley, Maybury and Ellis et al., U.S. Patent No. 
5,436,653 (hereinafter Ellis). 

Regarding claims 3 and 23: The combined teachings of Kanevsky in 
view of Cobbley and Maybury, teach wherein the inferring comprises: identifying 
the repeat instances (see Kanevsky [col. 9, II. 34-46] for identifying matching 
segments); and storing records of the repeat instances in a database (see [col. 
10, II. 16-20] for storing matching segments for later retrieval). 

Kanevsky however does not explicitly teach wherein the inferring 
comprises the monitoring of one or more media streams. 
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Ellis however teaches a system for monitoring more than one broadcast 
signal (media stream) (see [fig. 1], [col. 8, II. 35-36], [col. 9, II. 14-17] where fig. 1 
is described to depict the monitoring of multiple media streams). 

At the time the invention was made it would have been obvious, to one of 
ordinary skill in the art, to monitor more than one broadcast signal, as taught in 
Ellis, to infer matching (repeating) media objects, as taught in Kanevsky, 
because doing such increase the scope of searchable media thus improving the 
breadth of searchable information and system efficiency (see [col. 4, II. 9-13]). 

Regarding claim 11: The combined teachings of Kanevsky in view of 
Cobbley and Maybury, teach wherein the identifying is based on an identifier 
included in the request, the identifier selected from the group comprising: a finger 
print of the media object (see Kanevsky [col. 9, II. 30-40] for using a voiceprint/ 
selected segment to retrieve a segment having similar acoustic information); and 
channel code associated with the media object (see Kanevsky [col. 10, II. 50-53] 
for performing a search with a particular channel). 

Kanevsky does not explicitly teach identifying based on an identifier 
comprising a time stamp. 

Ellis teaches identifying known broadcast segments by time (see [col. 9, II. 
59-61]). 

At the time the invention was made it would have been obvious, to one of 
ordinary skill in the art, to use an identifier with a time stamp, as taught in Ellis, to 
identify segments for retrieval, as taught in Kanevsky, because this is desirable 
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information used to maintain a record of segment occurrences (see [col. 9, II. 56- 
67]). 

4. Claims 6 and 24 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Kanevsky in view of Geshwind and Schultz U.S. Patent No. 5,737,734 (hereinafter 
Schultz). 

Regarding claims 6 and 24: The combined teachings of Kanevsky in 
view of Cobbley and Maybury, teach determining a number of related media 
objects (see Kanevsky [col. 9, II. 34-46] where multiple matching segments are 
identified; see also [col. 7, II. 63-67] where each unique segment is identified and 
given an ID tag such that the N-best list is generated where N represents a 
number of the best matching segments). 

Kanevsky does not explicitly teach wherein said related media objects 
occur within a close temporal proximity of the media object with a higher 
frequency of repeat instances relative to one another. 

Shultz however teaches where media objects occur in an order of 
relevance such that the objects most relevant to the query topic are positioned in 
a manner relative to one another so they can be readily identified by the user 
(see [col. 1, II. 38-55], [col. 2, II. 57-67]). 

At the time the invention was made it would have been obvious, to one of 
ordinary skill in the art, to combine the feature of allowing a user to query and 
retrieve a list of files relevant to the query topic in a manner readily identifiable by 
the user, as taught in Shultz, with providing the ability to number the resulting 
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matching segments, as taught in Kanevsky, because this would allow the user to 
readily identify media files most relevant to the query topic (see [col. 1,11. 50-55]). 
5. Claims 8 and 26 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Kanevsky in view of Geshwind, Cobbley, Maybury and Bolle et al., U.S. Patent No. 
6,675,174 B1 (hereinafter Bolle). 

Regarding claims 8 and 26: The combined teachings of Kanevsky in 
view of Cobbley and Maybury, teach all of the prior limitations but does not teach 
wherein the inferring comprises limiting returned media objects based on 
constraints contained within the request. 

Bolle however teaches where a search engine requests information 
(operates) on a target media stream and returns (produces) a report including the 
data and time information documenting when each unique media event started 
and ended. 

At the time the invention was made it would have been obvious, to one of 
ordinary skill in the art, that the date and time information retrieved from the 
target media stream, as taught in Bolle, could be used in a search, as taught in 
Kanevsky (see [col. 10, II. 50-62]), because additional search criteria would allow 
the user to further limit their search. 

Conclusion 
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